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Some Empirical Evidence on the Comparability 
of School Unit Residuals Based on Achievement 
and Non-Achievement Variables 

JOSEPH F. GASTRIGHT 
Cincinnati Public Schools 

The evolving interest in the objective assessment of school performance 
has raised an embarrassing issue for educators. The truth is that it is 
not that obvious how school performance should be quantified in order to 
establish output accountability. Methods which were acceptable in the 
past as descriptions of school status have proved unacceptable as measures 
of school performance. 

Until recently the question of school quality was handled by accredi- 
tation. This method focused on the resources and curricula of the school 
as though these factors were ends in themselves. Schools were periodically 
certified by a s i te v i s i t team wh i ch concent rated on such items as the 
number of books in the library, the variety of. co.iij::se^j^^^ 

background of the teaching staff. ""^^^ ^ 

Achievement test scores, if they were used at all, were used to 
characterize the population served by the school. Critics of school per- 
formance have dismissed this process as subjective and inherently pre- 
disposed to over_ rate the accomplishment of schools. 

These same critics have seized upon the standardized survey tests of 
academic achievement, given in some form in virtually all schools, as the 
appropriate objective measure of schoo 1 effect i venes s . This has often led 
to the unreasonable conclusion that the discrepancy between a school's 
achievement test scores and those of another school , or those of the national 
norm group, is an unbiased measure of the effectiveness of the school. 
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Quite clearly any achievement comparison which ignores both the ability 
levels of students entering the school and the surrounding conditions 
under which the school operates must be a fallacious measure of accepta- 
ble performance. 

Dyer (1966) has suggested that a more rational estimate of school 
effectiveness might be based on the discrepancy between the observftd 
output ach i evemen t scores of a ■ schbo and -mul t i p 1 e-reg ress i on -p redi ct i ons 
of its output achievement test scores predi^ measures of previous 

achievement and measures of hard-to-change conditions which affect 
learning. Dyer, Linn and Patton (1969) provided empirical evidence on 
the stability and comparability of residuals based on previous achievement 
alone obtained using four different methods of aggregating the achievement 
data. 

Method I utilized the regression of individual student output achieve- 
ment on student input achievement using a student sample identical at two 
gradeTevels (matched- 1 ong i tud i nal sample). Method II utilized the regres- 
sion of mean school system output on mean school system input for the same 
mT^IhldH^i-rudi-nai^s ample of students. Method III utilized the regression 
of mean school system inputl^^a-U^tudents available at those points in 
time (unmatched-longitudinal sample) . "^"tteth^^l-V^ 1 i zed regression of 
mean school system output on the concurrent school system mean of the 
earlier grade level (cross-sectional sample). 

Dyer, et. al. (1969), using the fifth grade ach i evemen tjcores to pre- 
dict eighth grade achievement scores ( I owa Test of Basic Skills), concluded 
that Methods I and I I were essentially interchangeable, but not comparable 
~l:b Methods I I I and IV. Operating under the assumption that the methods 
utilizing matched student samples were intrinsically superior to the 
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others, they concluded that Methods III and IV did not produce residuals 
which were sufficiently comparable to those from Methods I and II to serve 
as reasonable substitutes for them. 

Forsythe (1973) provided some evidence on a different kind of stability, 
the consistency of residuals for consecutive classes in the same school. 
He randomly sampled 50 students from each of 320 schools in Iowa and 
uti 1 izing Dyer' s Method II, predicted mean school twel f th-g rade ach i evement 
scores by using mean school ninth-grade achievement scores (Iowa, Test of 
Basic Skills). The multiple correlation coefficients reported by Forsythe 
are very consistent with those reported by Dyer. However, the inter- 
correlations between residuals for the consecutive years (median r=.28) 
were considerably lower than the random halves correlations reported by Dyer. 

Gastright (197^) reported that residuals from regression analyses 
based on school unit data which included school background variables (Dyer's 
Method Ml) were more stable from year-to-year than those reported by 
Forsythe- us ing the matched student samples. With the exception of Gastright's 
study, none of the published literature on longitudinal models studied the^_^_ 
use of non-achievement variables on the comparabi 1 i tynDf^re's^'rauars': 1^^.^-^.- - 
as had been proposed by Coleman (1966) and Jencks (1972), these variables 
are highly related to achievement, then their absence in mul t iple regress ion 
studies of school performance could invalidate the results. 

Convey (1975) used a simulated data base incl udi ng both previous 
achievement and SES variables to test the validity of three methods of 
obtaining residuals. He concluded that residuals based on school unit data 
were superior in a cost-effectiveness sense. Convey also concluded that ' 
non-achievement variables should be assessed on the basis of theory, previous 
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research, or insight rather than on an empirical basis in order to deter- 
mine the relative effectiveness of schools- 

With the exception of Gastright (197^) and Convey (1975) there are 
few reports which include non-achievement variables. .in...the determination . . 
of school effectiveness. Therefore, a major component in Dyer's original 
proposal for determining school effectiveness has received little attention 
in the literature. The purpose of this study is to examine the compara- 
bility of school unit residuals obtained using Dyer's Method II and Method 
Ml when these residuals are based on: a) previous achievement alone, 
b) previous achievement and school background variables, and c) school 
background vari ables alone. 

Procedures _ - — — — " - ' 

The data on school units were available on sixty-seven elementary schools 
in the Cincinnati Public School system. The Children in these schools were 
tested in the third grade in the spring of 1970 with the Metropolitan 
Achievement Test, Primary II level, and tested again in the spring of 

-1973 with the' MetTopol i tan Achievement-Test-j*- In termed! ate .leve.l .... 

Data on over 800 non-achievement variables were available for each 
of the elementary schools. This data is compiled from the census reports, 
city agen cjes, and various department s within the school system. 

Th'e individual student, results at both the third and sixth grades 
were matched on student name within each school to obtain the matched 
longitudinal population for Dyer's Method 11. After this matching, the 
remaining cards were alphabetized for the total system and matched to 
obtain the population of students who changed schools within the system 
between 1970 and 1973. This second matched longitudinal population was 
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sorted by school, based on their location in the sixth grade, and added 
to the first set. The total matched student population for this study for 
a particular.school includes both those students who remained in the school 
and those students who entered the school from within the system between 
1970 and 1973. 

The remaining set of unmatched third grade cards, by school, was 
made up largely of students who moved out of the system between 1970 and 
1973. However, small percentages of these students may have either failed 
a grade between the third and sixth grades, or missed the sixth grade 
testing for some other reason. 

The remaining set of unmatched sixth grade cards, by school, was made 
.up_ larqel-y of students who moved into the system between 197Q and 197 3 . 
However, small percentages of these students may have missed the third 
grade testing for some reason. 

The test scores at both the third and sixth grades were reported as 
raw scores. They were converted to the equivalent standard scores on the 
Metropolitan Achievement Test Battery for all analyses in this study. The 
means of both the matched longitudinal sample for each school and the 
unmatched longitudinal sample for each school were computed and used in 
all subsequent analyses. 

Thirty-seven input variables were selected from the eight hundred 
specific variables available on each school. This selection was on the 
■basis of previous research, continuing avai labi 1 i ty, and the estimated 
accuracy of the data. 



The variables in the School Information System have been analyzed 
previously to determine those variables which are most valuable as corre- 
lates of achievement. These studies have Identified a subset of inter- 
pretable and accurately collected variables which represent all of the 
major categories reported in the system. From this much shorter list, 
those variables which are only sporadically available were eliminated. 
The f i nar l i s t of potent i a 1 input var i ables cohtai hed thi rty-seVen 
achievement, mobility, and demographic variables. 

The thirty-seven input variables were factor analyzed and the factor 
matrix rotated via Kaiser's varimax method. The two highest loading 
non-achievement variables in each of the resulting seven factors were 
selected for use in the regression analyses, provided that the loading 
was at least .^0. Two mobility variables, percent transfer-in and percent 
transfer-out, were selected because of their use in previous research. 
The final list of input variables consisted then of the six subtests of 
the third grade Metropolitan Achievement Test (Word Knowledge, Word 
Analysis, Reading Comprehension, Mathematics Computation, Mathematics 
Concepts, .and Problem Solving) and fifteen mobility and demographic 
variables. 

The fifteen mobility and demographic variables included in the 
reg re s s i on equa t i onli^have^BeeiT^lVerr^ 
by the School Information System: 

Percent of Black Pupils (Black Membership) : Estimated percent 
of black pupils. Percent obtained by taking estimated number 
and dividing by school's average daily membership for a typical 
day. 
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Percent Trans f ers- I n : Percent o'f pupils entering a school from 
anotheV" Cincinnati school after permanent enrollment 4ay. Per- 
cent obtained by taking number and dividing by gross membership. 

Percent Transfers-Out : Percent of pupils leaving a school for 
another Cincinnati school after permanent enrollment day. Per- 
cent obtained by taking number and dividing by gross membership. 

Percent Leaving School: Percent of pupils leaving school after 
permanent enrollment day for all other reasons than going to 
another Cincinnati school or moving out of the Cincinnati school 
district (i.e., going to work, illness, dropouts , etc. ). Percent 
obtained by taking number and dividing by gross membership (for 
elementary) . 

Percent First Gra de Promotions: Percent of boys and girls pro- 
moted from the first grade to the second grade. The percent 
represents the quotient when the number of boys and girls pro- 
moted to the second grade is divided by the number of boys and 
girls in membership at the end of the school year. 

Average Years Teaching — System : Average number of years teachers 
have taught in the Cincinnati Public Schools. Number of years 
dJ*v.i-ded-^b:yuraumbar-^f-^te,ai:hers_oj3_s^^ 

obtained from Staff Analysis Report, Staff Personnel Branch. 

Average Age of Staff : Average age in years of staff members in 
each school. Cal cul ated . by totaling age of each staff member 
and dividing by number on staff. 

Pupil/Teacher Ra t io, Total School : Average number of pupils in 
kindergarten through sixth grade divided by regular teachers in 
same grades. 

Black Percent in Community : Percentage of black persons residing 
in the community. Diita obtained from 1970 Census Book. 

Averag.e Income of Families : This figure is the average income for 
a "typical" family in a school attendance area. This figure is 
pjbtajned^^^ the 1970 Census Book. 

Percentage of Families Below Poverty Level : Percent of families 
below the defined poverty level. Percent obtained by taking 
number of families below poverty level and dividing by number 
of families in school attendance area. 

Percent of Registrants Voting : Percent of persons in""~a "school 
attendance area who actually voted. Percent found by taking num- 
ber voting and dividing- by number of registrants. 
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Percenta c^e Employed; Total percent employed in a school area as 
either professional, technical, kindered workers, laborers, etc^ 
Percent of people employed obtained by taking number of persons 
employed and dividing this number by total .number of persons 16 
years of age and over. 

Absence Per Employee : Days absent for certificated employees or 
^ for itinerant and subst i tute teachers assigned to a school. 
Calculated by taking total days of staff absence and dividing by 
number of staff. 

Percent of Capaci ty Be ing Used: This figure represents how many 
students are actual ly occupy ing the bui 1 ding . Thi s percentage is 
obtained by taking the capacity of the building and divl-ding by 
average daily membership. 

For each regression analysis, the dependent variable was the school 
unit mean on the Reading Comprehension subtest of the Metropolitan 
Achievement Test battery. A step-wise multiple regression procedure was 
used for these analyses. The input measure that had the highest correla- 
tion with the output measure was selected first. The input measure which 
added most to the multiple correlation, after control for the first 
measure, was selected next for inclusion. This process was repeated by 
adding input measures to the equation until the squared multiple correla- 
tion increased by less than .01. 

Residuals were computed as the simple difference between the observed 
school unit value on the dependent variable, and the predicted value 
obtained from a particular multiple regression equation. 

Resul ts 

Achievement test scores were available on 7161 students in the sixty- 
seyen^ejementary schools- at either- the third grade (April 1971) or the sixth 
grade (October 1973). Table 1 summarizes the composition of both the 
matched group of students, the group for which both third and sixth grade 
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achievement test scores available, and the unmatched group of students, 
the group containing all the. students tested at the third and sixth grades, 

(INSERT TABLE 1) 

It will be seen in Table 1 that 178^ students, or some 29 percent of 
the third grade population did not appear for testing in the sixth grade, 
Kost of these students moved out of the system; however, some of the missing 
students failed a grade between the testing dates, or missed the sixth grade 
testing for some other reason. Seventeen percent of the total sixth grade 
population, 893 students, were not tested with the third grade population. 
The majority of these students moved into the system from some other 
school district between the testing dates; however, some of them were 
failures from the previous cohort or students who missed the third grade 
testing for some other reason. , 

The mean population for individual schools using the matched group was 
67. Populations across all the schools for the matched group of students 
ranged from 20 to 162. The mean population for individual schools using 
the unmatched students was 80. Populations across all the schools with the 
unmatched students group ranged from 25 to 192. 

The intercorrelations among the school means on the input and criterion 
achievement variables for both the matched group (Method II) and the 
unmatched group (Method III) are given in Table 2. The simple correlations 
between the school means on the six third grade achievement variables with 
.-v-the school means on the cri terion. varlaMe.^..^^^^^^^^ reading comprehension , 

range from .89 to .9^ with the matched group, and from .87 to .93 with the 
unmatched group. In both cases the correlations of third grade reading 
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comprehension means with sixth grade reading comprehension is slightly 
higher than the correlations of the other input achievement variables with 
the sixth grade reading comprehension means^ 

(INSERT TABLE 2) 

The intercorrelations among the achievement test input variables for 
the matched group and the unmatched group are uniformly high. Inter- 
correlations for the matched group range from .88 to .97, with a. .median 
correlation of .93. Intercorrelations for the unmatched group range from 
.85 to .98 with a median correlation of .92. 

The correlations of the various input achievement test means for the 
matched group with the corresponding means for the unmatched group range 
from .96 to ,98. The correlations between the means on sixth grade 
reading comprehension test, between the matched and unmatched group; was .99 

The correlations between each of the non-cognitive variables and the 
sixth grade reading comprehension scores are presented in Table 3- The 
differences in the correlations of individual variables with the matched 
group sixth grade reading comprehension scores and the unmatched group 
reading comprehension scores are small. 

(INSERT TABLE 3) 

The multiple correlations between the set of third grade input 
measures and the sixth grade reading comprehension scores, for both 
Method II and Method I I 1^ are given in Table 4. In. the cases of both 
Method II and Method llli non-achievement variables contributed 
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significantly to the multiple regression prediction of school outputs, to 
the extent that they displaced input achievement variables in the stepwise 
multiple regression process, and to the extent that they contributed at 
least .01 to t* tiple correlations. However, the simple 

correlation ^ ^^esi nuividual predictor, previous fading comprehension 

means, was so high that the proportion of additional varlubllity accounted 
for by non-achievement variables is relatively low. 

(INSERT TABLE 

However, the total multiple correlation of the non-achievement 
variables alone with the school means sixth grade reading output was not 
only in the same order of magnitude as the prediction made by previous 
achievement, but was not significantly worse than those predictions for 
either Method II or Method III. 

The magnitudes of the multiple correlations are not an appropriate 
basis for comparing any one method or set of input variables with any 
other method or set of input variables for the purpose of deriving 
residuals as a measure of school performance. For the purpose of this 

I 

study, the relevant basis for comparison is to be found, rather, in the 
degree to which the deviations from the regression surfaces are similar 
or dissimilar across methods and sets of input variables. 

The intercorrelations between Method II and Method III range from 
.75 to .83. The residuals derived from Method II and those derived from 
Method III are comparable over the three different sets of input variables. 
The intercorrelations of the residuals from both Method II and Method III 
over the three sets of input variables are given in Table 5. 
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(INSERT TABLE 5) 



The correlations of all the residuals from the regress ion equat ions 
containing non-achievement vari ables wi th the residual from the matched 
group regression equations c \:aining previous achievement variables alone 
(Method II) indicate that icbiduals for the matched group based on both L 
achievement and non-achievement variables , and residuals for the unmatched 
group based on achievement variables alone, are highly comparable ( r^.SO) 
Residuals based on both ach i evement and non-achievement variables for the 
unmatched group are moderately correlated with those using Dyer's Method 1 1 

Residuals based on non-achievement variables alone..,are not 
significantly correlated with those based on Dyer's Method II (r^.20). 

In general, the intercorrelation of the residuals from the four sets 
of input variables within Methods 1 1 and III are in the same order of 
magnitude. 

Discussion 

The results reported in this study were obtained on a population 
different in certain respects from the population used by Dyer (I969). 
The basic unit of study in this population was the elementary school, 
whereas, the basic unit under study by Dyer was the school system. 

Dyer reported much larger changes between the input and output 
populations than those found in the present study. In Dyer's study, the 
matched group represented 56 percent of the total fifth grade population 
and 70 percent of the sixth grade population. In the present study, the 
group represented 72 percent of the third grade population and 83 percent 
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of the sixth grade population. The smaller differences between the matched 
and unmatched groups could easily account for the higher intercorrelation 
between residuals across methods found in the present study. ^ 

In the case of both the matched group (Method II) and the unmatched 
group (Method III), non-achievement variables contributed significantly 
to the m' '♦:iple regression prediction of. school outputs. The simple 
cor^' iait the input achievement predictors, however, are so high 

that Liic jioportion of addi tional variabi 1 i ty accounted for by the non- 
achievement variables is relatively low. 

Superficially, it would seem that mobility and demographic variables 
contribute a modest but relatively insignificant amount to the prediction 
of school outputs when they are entered in competition with measures of 
previous achievement. This interpretation could be sustained whether 

the data were based on the unmatched student population (Method III), or 

on the smaller matched student population (Method II). 

If the significant question for educational practice is reduced to 
the relative comparability of residuals based on the three sets of input 
variables across the matched and unmatched groups, then the answer is 
fairly simple based on the particular population of schools. School 
resi'dua.ls based on the unmatched student data are highly comparable to 
residuals based on matched student data, when the the inputs are restricted 
to achievement variables alone (r^.S). Dyer (1969)> using the school 
system data, found much smaller correlations between matched population 
and unmatched population residuals (r^.32), and concluded that the 
residuals based on matched population are interestingly superior to those 
based on unmatched population. 
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The significance of the comparability of residuals based on matched 
population and unmatched population is essentially a cost effectiveness 
question. If a school system can, arrive at essentially the same decision 
on the effectiveness of individual schools using unmatched school data, 
then the clerical and data processing task of building a matched 
longitudinal data base would be unnecessary. Correlations of residuals 
in the order of .8 are usually interpreted as evidence of impressive 
:oii ^'ability by researcheris . However, the 30 to ^0 percent of 
idiosynchrat ic variability, not common to these two estimates of school 
effectiveness, would be critical to administrators basing personnel and 
program decisions on residuals as indicators of school effectiveness. 

When non-achievement variables were added to Method III, the 
resulting residuals were less h i ghl y 'corre lated with those resulting from 
Method II using achievement vari|\||les than those whTch contained only 
achievement variables. There no iindicBtioxn that the addition of either 
mobility or school background ^^r^ biles served to make .unma^isAsed residuals 
more similar to matched residuals ised on achievement vari afales alone . 

Within both Method II and H^hod III the addition of nonr-a enlevement 
variables had similar effects on the comparability of the nesai^l t i rrg 
residuals. In each case the residuals based on achievement variables alone 
were strongly correlated with those based on combinations of achievement 
and non-achievement variables ^Ir^^^.S), but unrelated to those based on 
non-achievearaen t variables alone (r^^^l .2) . It appears that school 
performance indices, based on a combination of achievement and non- 
achievement variables occupy a position somewhere in between the independent 
predictions supplied by either of these sets of variables alone. The 
lack of relationship between residuals based on ach ievement and non-achieve- 
ment vari ables'^^as reported without supporting evidence by O^Connor (1972). 
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The decision to use non-achievement input variables in the production 
of residuals as measures of school effectiveness cannot be made on the 
basis of empirical studies. The existence of different sets of school 
unit residuals based on the use of different sets of input variables 
suggests that specification of the input variables is perhaps the crucial 
decision for the interpreter of residual gain score. 

The non-achievement variables used in the present study were selected 
pragmatically from the kinds of data which exist in most school systems. 
It is highly doubtful that these existing data sources exhaust the range 
of variables which affect the performance of schools. 

As the range of potential input variables increases, the question 
of the validity of the resulting residuals becomes more important, 
especially ifr the residuals are used to make decisions about the 
^ifticcountabi 1 ity of administrators or other staff. 

Future studies in this area will have to move from purely 
irnethodo logical solutions to the evaluative problems involved^to research 
an the causral models which underlie these regression solutions. 
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TABLE 1 



Summary of Student Data Available 
On Both Matched and Unrnatched Grcups 



Student Sample 



Grade ; 



Method I I 

Matched Group 
3 6 



Attended the same school 
Moved within the system 
In third grade, not sixth 
In sixth grade, not third 



3378 
1106 



3378 
1106 



Method I I I 

Unmatched Grogp 
3 6 



3378 
1106 
]78h 



3378 
1106 

873 



, Total Student Sample 



i»i»8i» 



6268 



5377 
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TABLE 2 



Intercorrelations Between School Heans on the Input and Criterion 
Achievement Variables for the Hatched and Unmatched Groups 



2 3 li 5 6 cr 7 8 9 10 H .12 cr 



Hatched Third Grade: 



; 1) Reading Comprehension 


1.0 


















2) Word Knowledge 


.97 


1.0 
















3) Word Analysis 


.95 


.96 


1.0 














k) Math Computation 


.92 


.90 


.88 


1.0,. 












5) Math Concepts 


.95 


.9^ 


.93 


.93 


1.0 






> 




6) Prabilem Solving 


.9'i 


.93 


.91 


.93 


.95 


1.0 








cr) 6th gr. Reading Comprehension 




.92 


.89 


.89 


.92, 


.92 


1.0 






Unmatched Third Grade: 
















1 




7) Reading Compiehen si on 


.98 


.97 


.95 


.91 


.92' 


.92 


:93 


1.0 




8) Woiid Knowledge . 


.96 


.93 


.95 


,89 


.92 


.91 


.31 


.98 


1:.0 


9) Word" Analysis • 


.91 


.93 


.96 


M 


..86 


.88 


.87 


.9V 


.35 1.0 


10) Math Computation 


.92 


.89' 


.87 


.98 


.91 


.92 


.8? 


.92 


...89 .85 1.0 


11) Math:;.Concepts 


.35 


.93 


.92 


.92 


.93 






r.9v 


.88 .92 


12) Problem Solving 




.93 


.92 


.92 


.36 


•97 . 


.91: 


^ .95 


.93 .88 . .33 


' cr).. 6th gr. Reading Comprehension 


.9^1 


.92 


.08 


.89 


.31 


.92 


.99 




.30 .87 .89 
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TABLE 3 



Correlations Between Non-Cognitive Varjables 
and Sixth Grade Reading Comprehension 
for Matched and Unmatched Groups 



Matched Unmatched 
Variable Group Group 



13. 


Percent Black Membersmip 


-.59 


- 71 
/I 


1 1 

1 4. 


Percerrr Transfers In 


78 




15. 


Percent Transfers Out: 


-.68 


-.70 


16. 


Percent: Leaving Schojal 


-.21 


- . Z2 


' 17. 


Percent First-Grade Promotions 


.37 


.Mi 


18. 


Average Years Teaching 


.32 


.29 


19. 


Average Age of Staff 


.28 


.25 


20. 


Pupil/Teacher Ratio 




.50 


21. 


Black Percentage in Community 


-.68 


-.70 


22. 


Average Income 


.81 


.82 


23. 


Percent Below Poverty Level 


-.76 


-.79 


Ik. 


Percent Registrants Voting 


.84 


.86 


25. 


Percent Employed 


M 


.52 


26. 


Absence Per Employee 


-.10 


-.10 


27. 


Percent Capacity Being Used 


.25 


.28 
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TABLE k 



Multiple .Correlations and Input Measures Included 
in the Multiple Regression Equation , In Order of Entry, 
For Each Method, Under Each Condition 



I nput 



Input 
Measures 
Included 



Method I I 
Matched 
Popul ation 



Input 
Measures 
I n1 cuded 



Method I II 
Unmatched 
Popul ation 



Achievement inputs 1 
alone 



.9^*6 



7rii 



.93^ 



Achievement, mobility, 1,2^,16, 
and school back- 27 
ground i nputs 



.962 



7,2/f,22, 
13,11 ,25 



.958 



Mobility and school 2^4 ,22 ,27, 
background inputs 14,15,25 
alone 



.922 



2^1,22,14, 
15,13,21 , 
25,27 



.950 
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TABLE 5 



Intercorr^lations of the Residuals of School System Means 
From the Regression Surfaces for Both Matched and Unmatched Groups 
Under Four Sets of Input Variables 



Variables 



1 



1. Achievement (M)" 

2. Achievement and non- 
achievement (M) 

3. Non-achievement (M) 



1.0 

.81 1.0 
.21 .55 



k. Achievement (U)-'^ 

5. Achievement and non- 
achievement (U) 

6. Non-.achievement (U) 



.80 .69 .25 1.0 

.6^ .75 -57 .80 1.0 

.18 Ah .83 .31 .63 .65 1.0 



Matched Group 
^'^Unmatched Group 
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